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In the Drawings: 

Please replace Figures 13 and 15 with the replacement sheets that are 
enclosed herein with this amendment. 
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REMARKS 

The Office action has been carefully considered. The Office action rejected 
claims 1 and 3-5 under 35 U.S.C. § 102(e) as being anticipated by U.S. Patent No. 
6,565,61 1 to Wilcox et al. ("Wilcox"). Further, the Office action rejected claims 6-7, 
12-16, and 18-20 under 35 U.S.C. § 102(e) as being anticipated by U.S. Patent No. 
6,304,674 to Cass et al. ("Cass"). Further yet, the Office action rejected claims 21- 
24, 26, and 28-38 under 35 U.S.C. § 102(b) as being anticipated by U.S. Patent 
No. 5,517,578 to Altman et al. ("Altman 1996"). Still further, the Office action 
rejected claim 2 under 35 U.S.C. § 103(a) as being unpatentable over Wilcox in 
view of A Tutorial on Support Vector Machines for Pattern Recognition, 1 998 by 
Burges, ("Burges"). The Office action rejected claims 8-11 and 17 under 35 U.S.C. 
§ 103(a) as being unpatentable over Cass in view of Burges. Finally, the Office 
action rejected claims 25 and 27-28 under 35 U.S.C. § 103(a) as being 
unpatentable over Altman 1996 in view of U.S. Patent Publication No. 
2002/0064308A1 also to Altman et al. ("Altman 2002"). Applicants note that claim 
28 is rejected under both § 102(b) and § 103(a). 

In addition to the claim rejections listed above, the Office action objected to 
Figs. 13 and 16 for informalities. Applicants have amended Figs. 13 and 16 
accordingly to obviate the objections and replacement sheets are included 
herewith. Regarding the claim rejections, applicants respectfully disagree. 

By present amendment, claims 1,6, 15, 21, and 34 have been amended for 
clarification and not in view of the prior art. Applicants submit that the claims as 
filed were patentable over the prior art of record, and that the amendments herein 
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are for purposes of clarifying the claims and/or for expediting allowance of the 
claims and not for reasons related to patentability. Reconsideration is respectfully 
requested. 

Applicants thank the Examiner for the interview held (by telephone) on 
February 15, 2006. During the interview, the Examiner and applicants' attorney 
discussed the claims with respect to the prior art. The essence of applicants' 
position is incorporated in the remarks below. 

Prior to discussing reasons why applicants believe that the claims in this 
application are clearly allowable in view of the teachings of the cited and applied 
references, a brief description of the present invention is presented. 

The present invention is directed to a method and system for separating text 
and drawings in a digital ink file (e.g., a handwritten digital ink file). To this end, the 
present invention may provide a stroke analyzer that classifies single strokes that 
have been input by a user as either in a "text" class or in an "unknown" class. 
Further, a grouping component may be provided that attempts to group strokes so 
as to form text objects (e.g., words, characters, or letters). The text objects may 
then be recognized or otherwise processed with more efficiency. 

To perform the stroke analysis, in accordance with one aspect of the present 
invention, a model for curvature features for single strokes may be trained using a 
trainable classifier, such as a support vector machine (SVM). The curvature 
features are typically represented by a curvature vector. The curvature vector may 
include information obtained, for example, by a tangent histogram or discreet 
curvature calculation of a stroke. Using the trainable classifier, a single stroke may 
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be classified in accordance with the stroke's curvature vector as either "text" or 
"unknown." 

In accordance with another aspect of the present invention, after the strokes 
have been classified as text or unknown, strokes may be grouped on a spatial 
basis. The spatial grouping may be based upon how close single strokes were 
made relative to one another, a time stamp basis (e.g., the proximity of time of 
creation of the stroke to the time of creation of other strokes), a combination of 
these, or based on other criteria. After strokes are grouped, a determination may 
be made as to whether the grouped text strokes are a text object (e.g., a word or 
letter). The grouped strokes may also be analyzed contextually on a global basis. 
The global contextual analysis involves evaluating the strokes in the group against 
the strokes in the digital ink file, including those outside the stroke group. This 
evaluation aids in determining if one or more strokes are to be eliminated from 
and/or added to the text group. 

Note that the above description is for example and informational purposes 
only, and should not be used to interpret the claims, which are discussed below. 

§102 Rejections 

Turning to the claims, independent claim 1 recites a computer-readable 
medium having computer-executable instructions, comprising accessing a plurality 
of stroke samples, the stroke samples representing more than one class, wherein 
at least one class represented is a text class and at least one class represented is 
a drawing class, extracting curvature features of each of the strokes for each class, 
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and using the curvature features, training a trainable classifier to classify strokes 
for each class. 

The Office action rejected claim 1 as being anticipated by Wilcox. More 
specifically, the Office action contends that Wilcox teaches accessing a plurality of 
stroke samples, the stroke samples representing more than one class. Column 3, 
lines 52-54, column 4, lines 19-21 and 63-67 and column 5, lines 1-9 of Wilcox are 
referenced. Further, the Office action contends that Wilcox teaches extracting 
curvature features of each of the strokes for each class. Column 5, line 37 of 
Wilcox is referenced. Finally, The Office action contends that Wilcox teaches using 
the curvature features, training a trainable classifier to classify strokes for each 
class. Column 5, lines 29-33 and Fig. 2 of Wilcox are referenced. Applicants 
respectfully disagree. 

Wilcox is directed, generally, to a system for generating indexes for 
handwritten notes captured as digital ink in a computer. More specifically, the cited 
and applied section of Wilcox teaches recognition of sequences of strokes such 
that textual words and phrases may be recognized more easily. That is, not only 
does Wilcox teach recognizing individual symbols (i.e., alphanumeric characters) 
but also attempts to take handwriting recognition to another level by recognizing 
combinations of symbols (i.e., words and phases comprising alphanumeric 
characters). As a result, once a user of the handwriting recognition system enters 
a series of alphanumeric characters more than once (e.g., entering the term "3-D"), 
the system learns to recognize the term 3-D as an individual symbol, as opposed to 
three separate alphanumeric symbols. 
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The Office action contends that the recognition of the term 3-D can be 
likened to a class in and of itself. Applicants disagree with this interpretation of 
class, because the underlying alphanumeric characters remain part of a single 
class, namely a textual class. Notwithstanding the fact that the term, 3-D is 
comprised entirely of alphanumeric characters, the Office action equates words 
and phrases with a distinct class. 

This is an erroneous interpretation of the term class as used herein and in 
the art. However, applicants have amended claim 1 to point out this distinction 
more clearly. Claim 1, as amended, recites accessing a plurality of stroke 
samples, the stroke samples representing more than one class wherein at least 
one class represented is a text class and at least one class represented is a 
drawing class. Class, in the context of the present invention, refers to a difference 
between types of symbols. In one class, alphanumeric characters may comprise 
letters, numbers, words, and phrases, and may be referred to as a text class. In a 
different class, other non-alphanumeric symbols may be used for various 
handwritten drawings and/or figures {i.e., circles, squares, schematics, etc.) and 
may comprise a drawing class. Thus, the method of claim 1 is able to distinguish 
between different classes of handwriting; text vs. drawing, for example. 

Wilcox falls short of distinguishing between classes in that Wilcox does not 
teach distinguishing between classes of handwriting. Rather, Wilcox teaches a 
single class (text) and provides for a means of recognizing strings of characters in 
the single class of handwriting. Despite the fact that Wilcox refers to recognized 
strings of alphanumeric characters (e.g., 3-D) as a class, it is nothing more than 
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different combinations of characters from the same class. Distinguishing between 
characters and combinations of characters in one single class, as disclosed by 
Wilcox, is not the same as distinguishing between different classes by accessing 
stroke samples representing more than one class as recited in claim 1 . This is 
certainly true with regard to a drawing class as Wilcox is wholly unaware of any 
type of drawing class. Applicants submit that claim 1 is allowable over the prior art 
of record for at least the foregoing reasons. 

Applicants respectfully submit that dependent claims 3-5, by similar 
analysis, are allowable. Each of these claims depends either directly or indirectly 
from claim 1 and consequently includes the recitations of independent claim 1. As 
discussed above, Wilcox fails to disclose the recitations of claim 1 and therefore 
these claims are also allowable over the prior art of record. In addition to the 
recitations of claim 1 noted above, each of these dependent claims includes 
additional patentable elements. 

Turning to the next independent claim, amended claim 6 recites a computer- 
readable medium having computer-executable instructions, comprising, accessing 
a digital ink file having at least one stroke therein, extracting curvature features of 
the at least one stroke, based upon an analysis of the curvature features, 
determining whether the stroke is text, and based upon an analysis of the curvature 
features, determining whether the stroke is a drawing. 

The Office action rejected claim 6 as being anticipated by Cass. More 
specifically, the Office action contends that Cass teaches accessing a digital ink file 
having at least one stroke therein. Column 3, lines 36-37 of Cass is referenced. 
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Further, the Office action contends that Cass teaches extracting curvature features 
of the at least one stroke. Column 4, lines 3-8 and Fig. 2 of Cass are referenced. 
Finally, the Office action contends that Cass teaches based upon the curvature 
features, determining whether the stroke is text. Column 3, lines 45-50 and column 
4, lines 3-8 of Cass are referenced. Applicants respectfully disagree. 

Cass is directed, generally, to a system for recognizing user specified 
gestures by using Hidden Markov Models to incrementally train an input recognition 
device. More specifically, the cited and applied section of Cass discloses a mode 
for which the system of Cass may be trained. As Cass is generally aware, 
handwriting may include different kinds of gestures and/or strokes. As discussed 
above with regard to the present invention, one distinction between classes may be 
distinguishing text from drawings. Cass teaches a gesture class select module that 
may be toggled between two different classes. In the example of Cass, a user may 
designate a letter class, a number class, or a shape class by setting the gesture 
class select module to the appropriate setting. Thus, the system disclosed in Cass 
cannot distinguish between classes via stroke analysis and must be told which 
class of characters will be input during a training mode. That is, in order for the 
system of Cass to recognize letters, it must be in a letter class recognition mode to 
begin with. 

Again, the Office action has interpreted the term "class" in an unreasonably 
broad and improper manner. Claim 6 is directed to a method for actually 
distinguishing between a text class and a drawing class without being in a specific 
mode as directed by a switch. In specific, claim 6 recites based upon the curvature 
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features, determining whether the stroke is text. That is, the system of the present 
invention can actually distinguish between classes based on an analysis of 
curvature features of the input and does not need a manual class switch as is 
required by the system of Cass. In fact, the system of Cass is representative of the 
actual problem that the present invention seeks to remedy. Because the system of 
Cass necessarily requires a class switch to identify which class of input to expect, it 
cannot possibly be construed to teach determining whether the stroke is text based 
upon curvature features as recited in claim 6. The sole factor for distinguishing 
between classes in Cass is based upon the position of a switch and not based 
upon curvature features of digital ink. 

Furthermore, claim 6 has been amended to recite based upon the curvature 
features, determining whether the stroke is a drawing. Again, the present invention 
may distinguish a drawing class based upon curvature features and not based 
upon the position of a switch as taught by Cass. Applicants submit that claim 6 is 
allowable over the prior art of record for at least the foregoing reasons. 

Applicants respectfully submit that dependent claims 7 and 12-14 by similar 
analysis are allowable. Each of these claims depends either directly or indirectly 
from claim 6 and consequently includes the recitations of independent claim 6. As 
discussed above, Cass fails to disclose the recitations of claim 6 and therefore 
these claims are also allowable over the prior art of record. In addition to the 
recitations of claim 6 noted above, each of these dependent claims includes 
additional patentable elements. 
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Turning to the next independent claim, amended claim 15 recites a 
computer readable medium having stored thereon a data structure, comprising a 
first data field comprising data representing information regarding a plurality of 
classes of digital ink strokes, wherein the plurality of classes includes at least one 
text class and at least one drawing class, and a second data field comprising 
trained information regarding curvature features of each of the digital ink strokes. 

The Office action rejected claim 15 as being anticipated by Cass. More 
specifically, the Office action contends that Cass teaches a first data field 
comprising data representing information regarding a plurality of classes of digital 
ink strokes. Fig. 8 of Cass is referenced. Further, the Office action contends that 
Cass teaches a second data field comprising trained information regarding 
curvature features of each of the digital ink strokes. Column 5, lines 2-9 and Figs. 
4 and 6 of Cass are referenced. Applicants respectfully disagree. 

As discussed above, Cass is directed, generally, to a system for recognizing 
user specified gestures by using Hidden Markov Models to incrementally train an 
input recognition device. More specifically, the cited and applied section of Cass 
discloses a mode for which the system of Cass may be trained. Cass teaches a 
gesture class select module that may be toggled between two different states. In 
the example of Cass, a user may designate a letter class, a number class, or a 
shape class by setting the gesture class select module to the appropriate setting. 
Thus, the system disclosed in Cass cannot distinguish between classes by 
analyzing curvature features, and indeed must be told which class of characters 
will be input during a training mode. That is, in order for the system of Cass to 



19 



In re Application of Wang et al. 
Serial No. 09/895,429 

recognize letters, for example, it must be placed into a letter class recognition 
mode to begin with. 

Claim 15, however, is directed to a data structure having information for 
actually distinguishing between classes by an analysis of curvature features, i.e., 
without being in a specific mode as directed by a switch. In specific, claim 15 
recites a first data field comprising data representing information regarding a 
plurality of classes of digital ink strokes and a second data field comprising trained 
information regarding curvature features of each of the digital ink strokes. That is, 
the present invention can actually store information about curvature features in an 
effort to distinguish between classes and does not need a class switch as is 
required by the system of Cass. 

Furthermore, claim 15 has been amended to specifically call out text classes 
and drawing classes that may be distinguished by reference to curvature features. 
Applicants submit that claim 15 is allowable over the prior art of record for at least 
the foregoing reasons. 

Applicants respectfully submit that dependent claims 16 and 18-20, by 
similar analysis, are allowable. Each of these claims depends either directly or 
indirectly from claim 15 and consequently includes the recitations of independent 
claim 15. As discussed above, Cass fails to disclose the recitations of claim 15 
and therefore these claims are also allowable over the prior art of record. In 
addition to the recitations of claim 15 noted above, each of these dependent claims 
includes additional patentable elements. 
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Turning to the next independent claim, amended claim 21 recites a 
computer readable medium having computer-executable instructions, comprising, 
accessing a digital ink file having a plurality of strokes therein, determining a class 
for each of the plurality of strokes based upon an analysis of curvature features of 
the strokes, and grouping some of the strokes based upon local characteristics of 
the strokes to form grouped strokes. 

The Office action rejected claim 21 as being anticipated by Altman 1996. 
More specifically, the Office action contends that Altman 1996 teaches accessing a 
digital ink file having a plurality of strokes therein. Column 3, lines 60-61 and 
column 5, lines 10-20 of Altman 1996 is referenced. Further, the Office action 
contends that Altman 1996 teaches grouping some of the strokes based upon local 
characteristics of the strokes to form grouped strokes. Figs. 3 and 4A-4B of 
Altman 1996 are referenced. Applicants respectfully disagree. 

Altman 1996 is directed, generally, to a system for processing handwritten 
input into digital ink usable by a digital ink system. More specifically, the cited and 
applied section of Altman 1996 describes a method of grouping similar strokes 
together to form words, phrases and paragraphs. As such, a user may more easily 
implement digital ink within a word processing application. Altman 1996, however, 
does not distinguish between classes of digital ink data, such as distinguishing 
between text and drawings by an analysis of curvature features. Altman 1996 does 
disclose identifying a region in which digital ink is entered as referenced by the 
Office action. However, the sole determination of whether the data entry is text or 
is a drawing, as taught by Altman 1996, is a region where the data was entered. 
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Thus, if a user's pen stroke enters a "drawing region," the system of Altman 1996 
designates all data input as a drawing, but if no user's pen stroke falls within the 
drawing region, then all input is designated as text. 

Amended claim 21 , however, recites determining a class for each of the 
plurality of strokes based upon an analysis of curvature features. That is, claim 21 
is directed to a method for distinguishing between different classes for digital ink 
data and the data input is, in and of itself, used to determine any class by which it 
may be identified. Similar to the previous references, Altman 1996 falls short of 
this in that the groupings of similar strokes into words, phrases, and paragraphs 
remain wholly within a single class, namely a textual class. Furthermore, Altman 
1996 cannot be construed to teach determining a class for each of the plurality of 
strokes based upon an analysis of curvature features as recited in claim 21 
because any determination of class is based upon the location of the input. 
Applicants submit that claim 21 is allowable over the prior art of record for at least 
the foregoing reasons. 

Applicants respectfully submit that dependent claims 22-24, 26, and 28-33, 
by similar analysis, are allowable. Each of these claims depends either directly or 
indirectly from claim 21 and consequently includes the recitations of independent 
claim 21. As discussed above, Altman 1996 fails to disclose the recitations of 
claim 21 and therefore these claims are also allowable over the prior art of record. 
In addition to the recitations of claim 21 noted above, each of these dependent 
claims includes additional patentable elements. 
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Turning to the last independent claim, amended claim 34 recites a computer 
readable medium having computer-executable instructions, comprising accessing a 
digital ink file having a plurality of strokes therein, determining a class for each of 
the plurality of strokes based upon an analysis of curvature features of the strokes, 
and grouping some of the strokes based upon characteristics of the plurality of 
strokes. 

The Office action rejected claim 34 as being anticipated by Altman 1996. 
More specifically, the Office action contends that Altman 1996 teaches the 
recitations of claim 34 and cites the same rationale as cited with respect to the 
rejection of claim 21. Applicants respectfully disagree. 

As discussed above, Altman 1996 is directed, generally, to a system for 
processing handwritten input into digital ink usable by a digital ink system. More 
specifically, the cited and applied section of Altman 1996 describes a method of 
grouping similar strokes together to form words, phrases and paragraphs. As 
such, a user may more easily implement digital ink within a word processing 
application. Altman 1996, however, does not distinguish between classes of digital 
ink data based upon an analysis of curvature features of the digital ink input, such 
as distinguishing between text and drawings. 

Amended claim 34, however, recites determining a class for each of the 
plurality of strokes based upon an analysis of curvature features. That is, claim 34 
is directed to a method for distinguishing between different classes for digital ink 
data by identifying curves and characteristics of the actual digital ink input and not 
from any location that the digital ink may be input from. Similar to the previous 
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references, Altman 1996 falls short of this in that the groupings of similar strokes 
into words, phrases and paragraphs remain wholly within a single class, namely a 
textual class. Altman 1996 does not teach determining a class for each of the 
plurality of strokes based upon an analysis of curvature features as recited in claim 
34. Applicants submit that claim 34 is allowable over the prior art of record for at 
least the foregoing reasons. 

Applicants respectfully submit that dependent claims 35-38, by similar 
analysis, are allowable. Each of these claims depends either directly or indirectly 
from claim 34 and consequently includes the recitations of independent claim 34. 
As discussed above, Wilcox fails to disclose the recitations of claim 34 and 
therefore these claims are also allowable over the prior art of record. In addition to 
the recitations of claim 34 noted above, each of these dependent claims includes 
additional patentable elements. 

§103 Rejections 

The Office action rejected several dependent claims under 35 U.S.C. § 
103(a). More specifically, the Office action rejected claim 2 as being unpatentable 
over Wilcox in view Burges. The Office action rejected claims 8-11 and 17 as 
being unpatentable over Cass in view of Burges. Finally, the Office action rejected 
claims 25 and 27-28 as being unpatentable over Altman 1996 in view of Altman 
2002. 

Each of these dependent claims depend from independent claims 
addressed previously with respect to the respective §102 rejection of the 
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corresponding independent claims. As was explained above, the recitations of the 
independent claims are not taught by the respective references cited, (i.e., Wilcox 
does not teach claim 1, Cass does not teach claims 6 and 15, and Altman does not 
teach claim 21 and 34). As such, the combination of these references with other 
references cannot possibly be construed to teach the recitations of the various 
dependent claims. Furthermore, the combination of the respective primary 
references with the various secondary references cited in the §103 rejections also 
fail to even suggest the recitations of the respective rejected claims cited by the 
Office action. Simply put, the prior art of record, whether considered as individual 
references or in any permissible combination with each other, still fails to teach or 
suggest the recitations of claims 2, 8-1 1,17, 25, and 27-28. Applicants submit that 
these claims are allowable over the prior art of record. 

For at least these additional reasons, applicants submit that all the claims 
are patentable over the prior art of record. Reconsideration and withdrawal of the 
rejections in the Office action is respectfully requested and timely allowance of this 
application is earnestly solicited. 
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CONCLUSION 

In view of the foregoing remarks, it is respectfully submitted that claims 1-38 
are patentable over the prior art of record, and that the application is in good and 
proper form for allowance. A favorable action on the part of the Examiner is 
earnestly solicited. 

If in the opinion of the Examiner a telephone conference would expedite the 
prosecution of the subject application, the Examiner is invited to call the 
undersigned attorney at (425) 836-3030. 

Respectfully submitted, 




Albert S. Michalik, Reg. No. 37,395 

Attorney for Applicants 

Law Offices of Albert S. Michalik, PLLC 

704 - 228th Avenue NE, Suite 193 

Sammamish, WA 98074 

(425) 836-3030 

(425) 836-8957 (facsimile) 
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CERTIFICATE OF MAILING 



I hereby certify that this Amendment and Transmittal, along with two (2) 
sheets replacement drawings, are being deposited with the United States Postal 
Service on the date shown below, with sufficient postage as first class mail, in an 
envelope addressed to: Commissioner for Patents, Alexandria, VA 22313. 



Date: March 13, 2006 




2810 Amendment 



27 



